Appl.No. 09/526,031 

Reply to Office action of August 9, 2007 

Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the application: 

Listing of Claims: 

1 . (Previously Presented) A method comprising: 

creating a multimedia annotation for a paper document, the multimedia annotation 
representing at least one of an audio sound and a video clip; and 

creating a first multimedia document by combining the paper document and the 
multimedia annotation represented by a first bar code encoding the at least one of the 
audio sound and video clip, 

wherein the first multimedia document is generated as a part of reproducing the 
paper document via a document reproduction system, wherein the multimedia annotation 
is captured via an input device of the document reproduction system while the paper 
document is being reproduced via the document reproduction system, wherein the 
captured multimedia annotation is encoded within the first bar code, and 

wherein the first multimedia document, which when scanned by a process, the 
process causes the printed multimedia annotation to be decoded, the at least one of the 
audio sound and video clip to be extracted from the multimedia annotation, and the at 
least one extracted audio sound and video clip can be played via a multimedia player. 

2-3 (Canceled) 
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4. (Previously Presented) The method of claim 1, wherein a location indicator associated 
with the multimedia annotation is placed on the first multimedia document, wherein the location 
indicator indicates where the multimedia annotation can be retrieved and played. 

5. (Previously Presented) The method of claim 4, wherein the location indicator 
comprises a first Uniform Resource Locator (URL), and a second bar code, wherein the first 
URL is indicated in plain text, and wherein the second bar code represents the first URL in an 
encrypted form. 

6-7. (Canceled) 

8. (Previously Presented) The method of claim 1, further comprising: 

generating an image of the paper document, the image of the paper document 
being unconsciously captured via the document reproduction system during the 
reproduction of the paper document without user intervention; 

creating a second multimedia document by combining the image of the paper 
document and the multimedia annotation; and 

storing the image of the paper document and the multimedia annotation in a 
storage, wherein the second multimedia document is an electronic document associated 
with the first multimedia document which is a physical document. 

9. (Previously Presented) The method of claim 8, wherein the second multimedia 
document is represented as a second Uniform Resource Locator (URL) printed on the first 
multimedia document, and wherein the image of the paper document and the multimedia 
annotation is accessed with the second URL. 
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10. (Original) The method of claim 9, wherein a third bar code is used to represent the 
second URL. 

11. (Previously Presented) The method of claim 8, further comprising automatically 
sending the second multimedia document to a recipient by electronic mail as a part of 
reproducing the paper document via the document reproduction system, wherein the recipient is 
specified by a user via an interface of the document reproduction system when the user 
reproduces the paper document using the document reproduction system. 

12. (Original) The method of claim 11, wherein the recipient receives the image of the 
paper document and the multimedia annotation in the form of Multi-purpose Internet Mail 
Extension (MIME). 

13. (Previously Presented) A machine-readable medium providing instructions, which 
when executed by a set of one or more processors, cause said set of processors to perform the 
following: 

creating a multimedia annotation for a paper document, the multimedia annotation 
representing at lest one of an audio sound and a video clip; and 

creating a first multimedia document by combining the paper document and the 
multimedia annotation represented by a first bar code encoding the at least one of the 
audio sound and video clip, 

wherein the first multimedia document is generated as a part of reproducing the 
paper document via a document reproduction system, wherein the multimedia annotation 
is captured via an input device of the document reproduction system while the paper 
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document is being reproduced via the document reproduction system, wherein the 
captured multimedia annotation is encoded within the first bar code, and 

wherein the first multimedia document, which when scanned by a process, the 
process causes the printed multimedia annotation to be decoded, the at least one of the 
audio sound and video clip to be extracted from the multimedia annotation, and the at 
least one extracted audio sound and video clip can be played via a multimedia player. 
(Canceled) 

14-15 (Canceled) 

16. (Previously Presented) The machine-readable medium of claim 13, wherein a location 
indicator associated with the multimedia annotation is placed on the first multimedia document, 
wherein the location indicator indicates where the multimedia annotation can be retrieved and 
played. 

17. (Previously Presented) The machine-readable medium of claim 16, wherein the 
location indicator comprises a first Uniform Resource Locator (URL), and a second bar code, 
wherein the first URL is indicated in plain text, and wherein the second bar code represents the 
first URL in an encrypted form. 

18-19 (Canceled) 

20. (Previously Presented) The machine-readable medium of claim 13, further 
comprising: 
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generating an image of the paper document, the image of the paper document 
being unconsciously captured via the document reproduction system during the 
reproduction of the paper document without user intervention; 

creating a second multimedia document by combining the image of the paper 
document and the multimedia annotation; and 

storing the image of the paper document and the multimedia annotation in a 
storage, wherein the second multimedia document is an electronic document associated 
with the first multimedia document which is a physical document. 

2 1 . (Previously Presented) The machine-readable medium of claim 20, wherein the 
second multimedia document is represented as a second Uniform Resource Locator (URL) 
printed on the first multimedia document, and wherein the image of the paper document and the 
multimedia annotation is accessed with the second URL. 

22. (Original) The machine-readable medium of claim 21, wherein a third bar code is 
used to represent the second URL. 

23. (Previously Presented) The machine-readable medium of claim 20, further 
comprising automatically sending the second multimedia document to a recipient by electronic 
mail as a part of reproducing the paper document via the document reproduction system, wherein 
the recipient is specified by a user via an interface of the document reproduction system when 
the user reproduces the paper document using the document reproduction system. 

24. (Original) The machine-readable medium of claim 23, wherein the recipient receives 
the image of the paper document and the multimedia annotation in the form of Multipurpose 
Internet Mail Extension (MIME). 
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25. (Previously Presented) A computer system, comprising: 
a bus; 

a data storage device coupled to the bus; and 

a processor coupled to the data storage device, the processor operable to receive 

instructions which, when executed by the processor, cause the processor to 
perform a method comprising creating a multimedia annotation for a paper document, 
the multimedia 

annotation representing at least one of an audio sound and a video clip; 

and 

creating a first multimedia document by combining the paper document and 
the multimedia annotation represented by a first bar code encoding the at least one of 
the audio sound and video clip, 

wherein the first multimedia document is generated as a part of reproducing 
the paper document via a document reproduction system, wherein the multimedia 
annotation is captured via an input device of the document reproduction system while 
the paper document is being reproduced via the document reproduction system, 
wherein the captured multimedia annotation is encoded within the first bar code, and 

wherein the first multimedia document, which when scanned by a process, the 
process causes the printed multimedia annotation to be decoded, the at least one of 
the audio sound and video clip to be extracted from the multimedia annotation, and 
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the at least one extracted audio sound and video clip can be played via a multimedia 
player. 

26-27 Canceled) 

28. (Previously Presented) The computer system of claim 25, wherein a location indicator 
associated with the multimedia annotation is placed on the first multimedia document, wherein 
the location indicator indicates where the multimedia annotation can be retrieved and played. 

29. (Previously Presented) The computer system of claim 28, wherein the address 
comprises a first Uniform Resource Locator (URL), and a second bar code, wherein the first 
URL is indicated in plain text, and wherein the second bar code represents the first URL in an 
encrypted form. 

30-31 (Canceled) 

32. (Previously Presented) The computer system of claim 25, further comprising: 

generating an image of the paper document, the image of the paper document 
being unconsciously captured via the document reproduction system during the 
reproduction of the paper document without user intervention; 

creating a second multimedia document by combining the image of the paper 
document and the multimedia annotation; and 

storing the image of the paper document and the multimedia annotation in a 
storage, wherein the second multimedia document is an electronic document associated 
with the first multimedia document which is a physical document. 
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33. (Previously Presented) The computer system of claim 32, wherein the second 
multimedia document is represented as a second Uniform Resource Locator (URL) on the first 
multimedia document, and wherein the image of the paper document and the multimedia 
annotation is accessed with the second URL. 

34. (Original) The computer system of claim 33, wherein a third bar code is used to 
represent the second URL. 

35. (Previously Presented) The computer system of claim 32, M e r comprising 
automatically sending the second multimedia document to a recipient by electronic mail as a part 
of reproducing the paper document via the document reproduction system, wherein the recipient 
is specified by a user via an interface of the document reproduction system when the user 
reproduces the paper document using the document reproduction system. 

36. (Original) The computer system of claim 35, wherein the recipient receives the image 
of the paper document and the multimedia annotation in the form of Multi-purpose Internet Mail 
Extension (MIME). 

37-43 (Canceled) 

44. (Previously Presented) The method of claim 1, wherein the first multimedia document 
is a physical document having the first bar code printed thereon, which when scanned by a 
scanning device, causes first bar code to be decoded and the audio sound to be extracted from the 
first bar code, and wherein the extracted audio sound is capable of being played via an audio 
player. 

45. (Previously Presented) The method of claim 844, further comprising capturing an 
audio sound of the multimedia annotation from a user +who speaks into a microphone of the 
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input device when the user reproduces the paper document using the document reproduction 
system, wherein the captured audio sound is part of the multimedia annotation embedded within 
the first bar code, and wherein the audio sound can be extracted directly from the first bar code 
of the first multimedia document without having to access resources outside of the first 
multimedia document. 

46. (Previously Presented) The method of claim 45, wherein the microphone is 
automatically activated when the user selects a reproduction function of the document 
reproduction system to reproduce the paper document. 

47. (Previously Presented) The method of claim 8, further comprising capturing a video 
clip of the multimedia annotation from a user using a video camera of the input device when the 
user reproduces the paper document using the document reproduction system. 

48. (Previously Presented) The method of claim 47, wherein the video camera is 
automatically activated when the user selects a reproduction function of the document 
reproduction system to reproduce the paper document. 

49. (Previously Presented) The method of claim 8, further comprising, in response to a 
request to retrieve the second multimedia document, performing a content-based search for the 
requested multimedia document within the storage based on content of the multimedia 
annotation associated with the requested multimedia document. 

50. (Previously Presented) The method of claim 49, wherein the content-based search is 
performed via an optical character recognition (OCR) process on the multimedia annotation of 
the multimedia documents being searched. 
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51. (Previously Presented) The method of claim 49, wherein the content-based search is 
performed via a speech recognition mechanism on an audio sound of the multimedia annotation 
of the multimedia documents being searched. 

52. (Previously Presented) The method of claim 49, wherein the content-based search is 
performed on a video clip of the multimedia annotation based on an image of the user using face 
recognition techniques. 
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